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(57) Abstract: In some embodiments, an optical imaging 
system comprises a non-destructive optical device that 
obtains information concerning a target object and a 
X,Y positioning system that is capable of positioning 
one or both of the target object and the optical device 
to prc-detennined offset locations more closely spaced 
than the obtainable resolution of the optical device. A 
first "Tjase" image is produced and then overlapping 
additional images may be produced by the positioning 
one or both of the target object and the optical device 
to the pre-determined locations. The first image and the 
additional images may be combined to produce a single 
combined image that contains inherently more information 
tlian the first image or any of the additional images alone. 
The combined image then may be digitally restored and 
enhanced to produce an image with a greater resolution 
than the optical device yields. 
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Non-Destructtve Optical Imaging System 
For Enhanced Lateral Resolution 

CROSS-REFERENCE TO RELATED APPLICATIONS 

This application claims priority to U.S. Provisional Aiiplication Serial No. 60/412,827 titled 
'High-Resolution Vertical Scanning Interferometry," filed My 31, 2002, and incorporated herein by 
reference. 

BACKGROUND OF THE INVENTION 
Technical Field of the Invention 

The present invention relates generally to optical devices and more particularly to optimizations 
of optical devices. 
Bacl^ound Information 

Optical devices, such as cameras and microscopes, use electromagnetic radiation to obtain 
information describing a target object. For example, a microscope may use electromagnetic radiation 
in the form of visible light to obtain an intiage of microscopic bacteria. The information obtained fiiom 
an optical device describing a target object has an associated characteristic, referred to as resolution. 
The resolution defines the capacity of the optical device to resolve closely spaced features of the target 
object. The resolution of aii optical device may depend upon a number of factors, including the 
inherent physical characteristics of the device and the wavelengfli of electromagnetic radiation used by 
the device. 

An optical device may be used to produce an image of flie target object. The image may 
comprise elements referred to as '"pixels." Each pixel is associated with a single value that represents a 
measured property on the surfece of the target object The measured property may include brightness, 
temperature, height, reflectivity, or any other meaningful characteristic of a surface. Typically, each 
pixel is associated with a specific surface area of the target object. The area is often referred to as the 
"footprint of the pixel. The value associated with a particular pixel may represent the average of the 
measured property over the footprint of the pixel. 

An array of pixels forms an image. The array of pixels is most often in a square or rectangular 
pattern, but oflier patterns (e,g., circular) may also be used. The imaged area of the target object is 
detormined by the spacing and number of pixels in each of two, usually orthogonal, directions. The 
pixel spacing in a direction is the distance on the sur&ce of the target object between the center points 
of two adjacent pixel foo^rints. The spacing may be different in the two, usually orthogonal. 
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directions. The image length along one direction is given by the pixel spacing in that direction 
multiplied by the number of pixels in that direction. 

Lateral resolution is a measure of how close two features on the sur&ce of a target object may 
reside and still be distinguished in an image as two distinct features. Pixel spacing is often used as a 
rougih indicator of the lateml resolution. Typically, two features must be separated by at least two times 
the pixel spacing. In some imaging systems, there ntiay be additional constraints on the lateral 
resolution due to the overlapping of adjacent pixel footprints. When the additional constraints exist, the 
lateral resolution may be poorer than two times the pixel spacing. 

BRIEF SUMMARY 

In some embodiments, an optical imaging system comprises a non-destmctive optical device 
that obtains information concerning a target object and a X,Y positioning system that is capable of 
positioning one or both of the target object and the optical device to pre-determined offset locations 
more closely spaced than the obtainable resolution of the optical device. A first 'Ijase" image is 
produced and then overlapping additional images may be produced by the positioning one or both of 
the target object and the optical device to the pre-detemiined locations. The first image and the 
additional images may be combined to produce a single combined image that contains inherently more 
information than the first image or any of the additional images alone. The combined image then may 
be digitally restored and enhanced to produce an image with a greater resolution than the optical device 
yields. 

NOTATION AND NOMENCLATURE 

Certain terms are used throughout the following description and claims to refer to particular 
system components. As one skilled in the art will appreciate, various companies may refer to a 
con:q>onent by different names. This document does not intend to distinguish between components that 
differ in name but not fimction. In the following discussion and in the claims, the terms "'including"* 
and "comprising" are used in an open-ended &shion, and thus should be interpreted to mean 
"including, but not limited to...". Also, the temi "couple" or "couples" is intended to mean either an 
indirect or direct connection. Thus, if a first device coiq)les to a second device, that coxmection may be 
through a direct connection, or through an indirect connection via other devices and connections. 

BRIEF DESCRIPTION OF THE DRAWINGS 

For a more detailed description of the preferred embodiments of the present invention, 
reference will now be made to tiie accompanying drawings, wherein: 
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Figure 1 illustrates a diagram of exemplary interferometric system in accordance with 
preferred embodiments of the invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Hie following discussion is directed to various embodiments of the invention. Although one or 
5 more of these embodiments may be preferred, the embodiments disclosed should not be interpreted, or 
otherwise used, as linodting the scope of the disclosure, including the claims, unless otherwise specified. 
In addition, one skilled in the art will understand that flie following description has broad application, 
and the discussion of any embodiment is meant only to be exemplary of that embodiment, and not 
tQtended to intimate that the scope of the disclosure, including the claims, is limited to that 
10 embodiment 

The subject matter disclosed herein is directed to an optical imaging system that includes a non- 
destmctive optical device and a positioning system that precisely and controUably moves one or both of 
a target object and the optical device to pre-determined locations. A series of images with overlapping 
pixel footprints may then be acquired and software may combine the acquired images and restore the 
15 combined images to improve the lateral resolution. Merely by way of example, the embodiments 
described herein are directed to a Vertical Scanning Interferometric (VSI) imaging system with an X-Y 
positioning system. 

In accordance with preferred embodiments, a ''non-destmctive optical device" may include, but 
is not limited to, interferometric imaging systems and microscopic systems, tiiat create images on a 

20 small scale. The object desired to be imaged by the imaging system may be referred to as the ^target 
object" The non-destmctive nature of the optical device allows for a non-contact measurement of 
target objects, such as living organisms, that may be sensitive to contact and low wavelength 
electromagnetic radiation. The "obtainable resolution" of the optical device is the maximum 
sustainable lateral resolution capable of being produced solely by the optical device. 

25 hi accordance with the preferred embodiments, the lateral resolution of an imaging system with 

an optical device may be enhanced by acquiring a series of images. The '"base" image is a single image 
acquired by the imaging system. All images after the first, base image may be referred to as 
"additional" images. Each additional image may be acquired by the same imagmg system, but one or 
both of the target object and the optical device is moved to a new position difierent from that of the 

30 base image or any of the previous additional images via the positioning system. The new position is 
pre-determined and o&et fix>m the base image by a distance smaller than the obtainable resolution of 
the optical device. 
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The preferred embodiment utilizes additional images that are offiet fiom the base image by 
"sub-pixel" distances or sub-pixel plus integer fiiU-pixel distances. A sub-pixel distance is a distance in 
a direction less than the pixel spacing in that direction. The result of a sub-pixel of&et is that the 
footprint of many or all of the pixels in an additional image may be different &om the footprint of the 
S pixels in the base or previous additional images, hi accordance with the preferred embodiments, the 
difference in the pixel footprint distribution yields the additional information that may enhance the 
lateral resolution. 

In contrast, there are possible movements that do not yield additional information. For 
example, it is possible to move the target positioning system or the optical device to a new position in 

10 which all of the pixel footprints exactly overlay the pixel footprints of the base image. For example, in 
a square grid of pixels, if the target positioning system is moved exactly one pixel spacing along the 
alignment direction of the pixels and a new image is taken, then each pixel footprint (with the exception 
of some pixels on the outside edge of the image) is identical to the footprint of the neighboring pixel in 
HxG previous image. In this case the new image offers no additional useful information. The same is 

15 trae with movements by integer multiples of the pixel spacing along either of the alignment direction of 
the pixels. It may also be tme for movements by combinations of integer movements along both 
alignment directions of tilie pixels. 

The preferred embodiments may utilize any pattern of sub-pixel movements to enhance lateral 
resolution. Examples of possible pattems are 1) translations of the target object in small equal steps in 

20 the directions of pixel alignment, 2) translations of the target object in a finely spaced rectangular grid 
oriented in the directions of pixel alignment, 3) rotation of the target object in small steps about a point 
inside or outside the image area, and 4) translations of the target object in a finely spaced triangular 
grid. The same set of pattems apply to the movement of the optical device associated with the inciaging 
system ratiier than the movement of the target object. The effectiveness of the enhanced lateral 

25 resolution may depend upon the pattern of sub-pixel movements chosen. 

In altemative embodiments, random sub-pixel movements may also be used. With random 
sub-pixel movements, &ere is no pattern to the relative positions of the base image and additional 
images. The series of positions may, in genial, be different for every attempt to increase resolution. 
Each random position is pre-determined by the imaging system. 

30 VSI, one type of a non-destmctive optical device, is a technique for quantifying the topography 

of a reflective, solid sur&ce. The information obtained fix>m a VSI may be referred to as an 
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"interferogram." Typically, the inteiferogram obtained fix)m a VSI scan is rendered into an image in 
which each pixel value represents the height of a respective part of the target object's sur&ce. 

For many tasks, as is true of every optical imaging system, the obtainable lateral resolution 
associated with a VSI device may be insufficient In accordance with the preferred embodiments, 
5 enhanced lateral resolution may be achieved by taking multiple scans of a target object at sub-pixel 
offsets fix>m a targeted location. | 

Referring now to Figure 1, an exemplary interferometric system 100 is shown. Alfliough any 
type of interferometer, such Michelson and Linnik, may be used. Figure 1 illustrates an exemplary 
Mirau interferometric system 100. The interferometric system 100 comprises a main body 102 with an 
10 illuminator 104. In addition, a beam splitter 106, a target object 114, a reference mirror 110, and a 
reference plate 112, and a position system 108 are included in the interferometer system 100. Oflier 
components, such as a camera system 118 and a computer system that stores information generated by 
the optical device, and other configurations of the components may be similarly used. 

The VSI system may directly produce two types of images, a 2-dimensional reflected light 
15 image of the target object, and interferograms of the target object's siuface. The information stored in 
the interferograms may be used to generate a third type of image that is a three-dimensional height map 
of the target object's surfece. The three-dimensional height map may be viewed as a three-dimensional 
surface. Typically, the interferogram is produced by splitting light from the illuminator 104 into two 
beams by the beam splitter 106. The first beam is incident on a target object 114 and the second beam 
20 is incident on the reference mirror 1 10 that is coupled to the reference plate 112. The first beam travels 
a distance referred to as the 'target path," whereas the second beam travels a distance referred to as the 
•^reference path". The first and second beams reflect off the target object 1 14 and the reference mirror 
1 10 respectively and combine to produce a single beam. If the target path and the reference path are 
different lengths, the combination of the two beams produces interference. Since the reference path 
25 ficom the beam splitter 106 to the reference mirror 110 is known, the resulting interference patterns, 
referred to as interference fimges, may be used to determine flie Iragfh of the target path, and hence the 
distance to the target object 114. The lateral resolution of each of the three different image types, the 
reflected light image, the interferogram(s), and the height map, produced by the VSI system 100 may 
be enhanced by the disclosed method. 
30 In some embodiments, the target object 1 14 is placed on the positioning system 108 that allows 

controlled movements with nanometer-precision. These movraients are used to position the target 
object 114 to the sub-pixel location, as previously discussed. Jn other embodiments, the positioning 
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system is integrated into the objective side of the optical device and the positioning system moves the 
objective (or lense) to the desired sub-pixel locations. 

Typically, any positioning system coupled with an optical device has been used for positioning 
the target object under the optical device so that the desked part of the target object can be observed in 
the conect position. This type of positioning may be achieved by using X-Y stage devices, tip-tilt 
devices, rotation devices, or combinations of them. However, this type of positioning occurs at a larger 
scale (i.e., the micrometer (10"^ to millimeter (10"^)) than the sub-pixel movements carried out by flie 
positioning system 108. 

In some embodiments, a combination of a nano-positioning device with a micro- to millimeter 
precision positioning device is used. However, the latter device may have a tolerance, referred to as 
'*play,*' of more than 1 micrometer. The micro-precision device preferably is locked into position either 
mechanically, electro-mechanically, or by a combination of mechanical and electro-mechanical means 
and coupled with a nano-positioning device to achieve the sub-pixel movements. 

After a series of base and additional images have been obtained from the imaging system, the 
series of images maybe "combined" into a single, combined image with smaller pixel spacing than that 
of the base image or any of the additional images. The combining of images can be facilitated if the 
images are acquired in a pattem that is compatible with the base image pixel spacing. 

In some embodiments, image processing techniques may be used prior to image combination. 
For example, noise may be reduced in each image in the series. The noise reduction may be 
acconoplished using filters in which the desired filtering parameters are based on the nature of the noise 
present in the images. Random noise may also be reduced by acquiring multiple images without offset 
Hiese multiple images may be summed and divided by the number of images to create a single image 
with higher signal with respect to noise ratio. The resulting image can be used instead of a single image 
in the series of ofEset images. 

For combination to be effective and yield resolution enhancement, each of the images in the 
smes to be combined also may "balanced." Balance refers to the relative levels of a property (e.g., 
contrast, illumination) associated with images. A relatively sinqple example of unbalanced images 
would be two images acquired with different levels of illiunination. One image may be systematically 
brighter than the other image. If combined in previously mentioned way for enhancing lateral 
resolution, the resulting combined image would have a checkerboard appearance caused by the addition 
of short period noise. The noise may tend to swamp tiie subtie variations in pixel value that are 
exploited to achieve the enhanced lateral resolutioiL Each additional image may be processed by 
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comparison to the base image to balance the images. For example, the base image is inteipolated to 
predict the values at the oflfeet pixel locations in an additional image. The difference between the 
interpolated base image and the additional image is filtered to remove the short period variations and 
leave the long period variations. The filtered difference image is then added to the additional image. 
5 The parameters associated with the balancing and filtering may be selected based upon the 
characteristics (e.g., size, type of noise) of the images. 

If a series of images is acquired on a regular grid of offsets firom the base image, and if the grid 
spacing is set to be the base image pixel spacing divided by an integer, then the combination of the base 
and the additional images may be simplified. For example, a complete series of base image plus 
10 additional images may consist four images. The position of the base image is, by definition, given by 
the vector (0, 0). The first number in this vector is the ofi&et in units of the pixel spacing in one 
orthogonal direction of aligrmient of the pixels. This direction may hereafter be referred to as the X- 
axis. The second number in ttiis vector is the offset in units of the pixel spacing m the other direction 
of pixel aligmnent. This direction may hereafter be referred to as the Y-axis. The three additional 
15 images may be obtained with the target object positioned at (0.5, 0), (0, 0.5), and (0.5, 0,5) relative to 
the base image (0, 0). The four images may be combined by taking alternate pixels firom each image. 
Each group of four neighboring pixels in the combined image consists of one pixel firom each of the 
four images in the series. In the resulting combined image, the pixel spacing in each direction is now 
half that of the base image. The total area of the surfece of the target covered by the combined image is 
20 essentially the same as that of the base image. Thus, the lateral resolution may be enhance by a factor 
of two. The lateral resolution may be enhanced by any fiictor desured by obtaining more additional 
images at closer of&et locations. 

If the relative positions of the series of acquired images do not have a pattern that relates to the 
pixel distribution in the image, the process of combining the images may be more diflBcult The 
25 principal objective of the "combining;" step is to fill in additional pixels between the pbcels in the base 
image. Ideally, the additional pixels should fidl on a regular grid within the base image pixels. If the 
pattern of positions is chosen carefiilly, as described above, the pixels of the additional images may fell 
exactly on a regular grid within the base image pixels. On the other hand, if the pixels in the additional 
images have a different pattern or are random, having no pattern, then they may not fell exactly on a 
30 regular grid. In this case, interpolation will be required to estimate the value of a pixel at a desired 
location fix)m the values of nearby pixels selected fix>m the base image and series of additional images. 
The number of pixels that can reasonably be added between the pixels of the base image is a function 
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of how many additional images are acquired and how evraly they are positioned. The number of 
additional images required is roug^y related to the square of the desired &ctor resolution 
improvement. 

Although the pixels in the combined inoage are spaced more closely than in the base image or 
the additional images and the image may have a smoother appearance than that of the base image, the 
true lateral resolution may not been increased be the combination process. If the footprint of a pixel in 
the base image covered an area of the target object's sur&ce witiiout overlapping the footprint of any 
other pixel, then the footprint of each pixel in the combined image wiU cover the area four, now 
smaller, pixels. In this case, lateral resolution does not correlate directly with pixel spacing. However, 
there is inherently more information in the combined image than in the base image. The combined 
image may be treated as an image tiiat has the full lateral resolution of the closer pixel spacing of the 
combined image (i.e., without the pixel footprint overlap) that has been blurred. A type of blurring 
occurs when each pixel in an image is the average of the sur&ce property in a footprint larger than the 
pixel itself. So, the combined image is a blurred version of an image with enhanced lateral resolution. 

Removal of blurring (i.e., "deblurring'*) in an image is commonly done using a two 
dimensional deconvolution. Deconvolution is the inverse of a convolution. Blurring is often modeled 
as the convolution of an image with an operator that describes how the footprint of the neighboring 
pixels overlap. The operator is known as a '*point spread function." Typically, a method of two- 
dimensional deconvolution may reduce or remove the blurring in the combined image. There are a 
large nimiber of standard numerical techniques for performing two-dimensional deconvolution. A 
common technique is Weiner Deconvolution. The use of the Weiner Deconvolution requires that one 
knows the point spread function of the blurring. Determining the appropriate point spread function for 
a given imaging system requires knowledge of the system. There are so-called *T>lind deconvolution" 
methods that extract an estimate of the point spread function directly fix>m the blurred image and these 
can also be used on the combined image. Because of the broad applicability of image restoration using 
deconvolution methods, the range and power of the available numerical tools is expanding 
continuously and any method may be used to deblur the combined image to produce an image with the 
desired enhanced lateral resolution. 

Numerous variations and modifications will become apparent to those skilled in the art once the 
above disclosure is fiilly appreciated. It is intended that the following claims be interpreted to embrace 
all such variations and modifications. 
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CLAIMS 

What is claimed is: 

1 . A imaging system, comprising: 

a non-destractive optical device that obtains infomiation concerning a target object; and 
5 an X-Y positioning system adapted to position one or both of the target object and the optical 

device to multiple pre-determined locations wifli movements smaller than the 
obtainable lateral resolution of the optical device. 

2. The system of claim 1 wherein the non-destructive optical device comprises an 
interferometer. 

10 3. The system of claim 1 wherein the non-destructive optical device comprises a microscope. 

4. The system of claim 1 wherein the positioning system comprises a positioning system with 
nanometer-precision or better. 

5. The system of claim 1 wherein the positioning system positions with movements selected 
from the group consisting of rotation in the horizontal plane, rotation in the vertical plane, tilting in 

15 the horizontal plane, tilting in the vertical plane^ and a combination thereof. 

6. The system of claim 1 wherein the pre-determined locations are determined by rotating the 
target object. 

7. The system of claim 1 wherein the pre-determined locations are determined by selecting 
random sub-pixel locations. 

20 8, The system of claim 1 furth«r comprising a computer system coupled to the optical device for 
storing the information obtained from the non-destructive optical device. 

9. The system of claim 1 wherein the positioning system comprises a first positioning system 
with a precision an ordo: of magnitude better than a second position positioning system that is 
coupled to the first positioning system. 
25 10. The system of claim 9 wherein the second positioning system is locked into place with a 
locking device selected form tiie group consisting of a mechanical lock, a electrical lock, or a 
combination of thereof. 

11. A method for producing high-resolution images of a target object with a non-destructive 
optical device, tiie method comprising: 
30 positioning one or both of the target object and the non-destructive optical device to pre- 

determined ofi&et locations more closely spaced than the obtainable resolution of the 
optical device; 
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producing a plurality of images from information generated by fhe optical device at the ofiEset 
locations; and 

combining the plurality of images to produce a single combined image. 

12. The method of claim 11 further comprising stacking the images produced from the ofi&et 
locations to reduce noise associated with the images. 

13. The method of claim 11 fitrther comprising deblurring the single combined image using a 
mathematical operations selected from the group consisting of inverse filters, deconvolution 
filters, direct inverse filters, Wiener filters, regularized deconvolution filters, blind 
deconvolution filters. Wavelet-based inverse filters, and combinations thereof 

14. A non-destructive optical imaging system, comprising: 

a means for obtaining information describing a target object with electromagnetic radiation; 
a means for positioning the target object and/or imaging system to pre-determined ofiEset 

locations smaller than the obtainable resolution of the information; and 
a means for generating images from the information; and 
a means for combing the genemted images into a single combined image. . 

15. The non-destructive optical imaging system of claim 15 fiirther comprising a means for 
deblurring the single combined image. 

16. A method for producing images of a target object with a optical . device, the method 
comprising: 

positioning one or both of the target object and the optical device to pre-determined ofi&et 
locations more closely spaced than the obtainable resolution of the optical device; 

producing a plurality of images at each of&et location from information generated by the 
optical device; 

stacking the plurality of images producing at each o£&et location to remove noise; and 
combining the stacked images into a single combined image with a pixel spacing less tiian 

the pixel spacing of the pixel spacing of the pliirality of images producing at each 

of&et location. 

17. The method of claim 16 fiirther comprising deblurring the single combined image using a 

ma&enmtical operations selected from the group consisting of inverse filters, 
deconvolution filters, direct inverse filters, Wiener filters, regularized deconvolution 
filters, blind deconvolution filters. Wavelet-based inverse filters, and combinations 
thereof. 
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1 8. The method of claim 16 wherein the optical device is selected firom the group consisting of a 
microscope and an interferometer. 
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